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DETAILED ACTION 
Response to Arguments 

Applicant's arguments, see Remarks pages 1-5, filed 31 May 2005, with respect 
to the rejection(s) of various claim(s) under 35 U.S.C. 102(b) and 35 U.S.C. 103(a) have 
been fully considered but are not persuasive. 

New grounds of rejection for all of the above claims follow below. 

Further action on the claims with respect to art rejections is not possible at this 
time. The prior rejections will be held until applicant amends the claims to bring them 
into compliance with 35 U.S.C. 112, first paragraph. 

Allowable Subject Matter 

The indicated allowability of any and all claims (1-38) is withdrawn in view of the 
newly found problems with enablement, as set forth below. 

Claim Rejections - 35 USC §112 

The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, dear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 1,18, 22, 26, 30, and 34 as well as 2-17, 19-21, 23-25, and 27-30 stand 
rejected under 35 U.S.C. 112, first paragraph, as based on a disclosure which is not 
enabling. A training step or portion of an apparatus for training the view modeler, which 
is critical or essential to the practice of the invention, but not included in the claim(s), is 
not enabled by the disclosure. See In re Mayhew, 527 F.2d 1229, 188 USPQ 356 
(CCPA 1976). To briefly review Mayhew, the inventor disclosed in the specification that 
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for successfully producing the desired result, namely a metallic alloy having certain 
improved properties, it was necessary that the ingot be removed from the bath into a 
cooling zone having a temperature different than that of the metal bath. However, the 
claims did not require the cooling zone to be present. CCPA found the claims not to be 
enabled for this omission in the claims. The cooling zone in this particular instance is 
comparable to the view modeler and especially the training, since applicant's invention 
will not work without training the system either in studio or on location first (see for 
example Figures 2-4, etc). See below for further, more detailed explanation. 

Paragraph [0074] of the specification of the instant application, step 1C, 
Determining the Fixed Inductive Transform Parameters (e.g. all steps involving 
transform functions, fixed transform parameters, or the like) states inter alia, "In order to 
correctly utilize this sensor information within a live or post-production setting, the view 
modeler must be trained (calibrated) beforehand." (Emphases added) Further 
evidence is found in paragraph [00040] - which states inter alia, "The system and 
method described herein contains a novel view modeling technique..." The above 
shows that the view modeling technique is essential to the practice of the invention. 

Now, applicant's invention is primarily the fact that (allegedly) the system does 
not require any reference to the content of the image sequence and without reference to 
any three-dimensional real world space or dimensions (see claim 1; see Remarks 
pages 1-2, concerning why allegedly the Kreitman reference is not valid). The key to 
that appears to be, based on for example paragraphs [0073-0076] of the instant 
specification, as well as Figure 1 , and the various other Figures, two things: 
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1. That the camera has pan, tilt, focus, and zoom sensors (optionally others, 
such as iris closure); and 

2. That the system trains based on each of these parameters, so that it forms a 
model of its location, and the user refines each color region. 

Then, it can automatically process image streams without reference to any three- 
dimensional location per se. 

NOTE: Examiner further asserts that the claims are not enabled because they 
do not discuss how the system functions, e.g. the defining feature is the training, and 
that is because the user trains the view modeler. 

NOTE: Further, the claims are fundamentally not enabled as written, because 
the system simply will not work if the transformations are not done with regards to the 
content of the image sequence. For example, note applicant's specification in 
paragraph [00039], where dynamically moving highlights are laced on the hoods of the 
cars involved in the wreck. In order for this to work, the motion of the cars must be 
taken into account. The wording of the claims is simply not acceptable in this regard; it 
is no way accurate or conforming to the material disclosed in the specification. 

The independent claims 1,18, 22, 26, 30, and 34 are not enabled as per above. 
The dependent claims also fail to remedy the deficiencies of their parent claims, and 
thus are all rejected. 

Applicant is encouraged to call examiner to discuss this rejection and ways to 
amend the claims to overcome this rejection. Examiner has pointed out as above 
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various flaws in the claims, and conversely the inclusion of the material indicated as 
critical by examiner would result in the withdrawal of this rejection against all claims. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

1. Claims 1-6, 18, 22, 26, and 34-36 are rejected under 35 U.S.C. 102(b) as being 
anticipated by Kreitman, U.S. Patent No. 5,491,517. 

With regard to claim 1 , Kreitman describes applying a transform function to visual 
content to be inserted into an image sequence (see Kreitman, Figs. 2, 4, and col. 7, line 
64 to col. 8, line 9, wherein image 42 of Fig. 4 is transformed to match the perspective 
of the input video frame of Fig. 2 and is inserted into the video frame of Fig. 2); and 
blending the transformed visual content with the image sequence (see Kreitman, col. 6, 
lines 26-37, Fig. 4C, and col. 8, lines 1-9, wherein transformed blending mask 58 is 
utilized to blend the image 42 with the colors of the field on which the image 42 is 
implanted); wherein the transforming step and the blending step together result in 
insertion of the content into the image sequence such that the content appears at a 
target location as if it had been part of the original scene displayed by the image 
sequence (see Kreitman, col. 8, lines 1-9, wherein if players walk on the part of the 
court 32 where the image 42 is implanted, they will appear to walk "over" the implanted 
image); and wherein the transforming step comprises all applied geometric 
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transformations of the visual content, is performed without reference to any content of 
the image sequence, and is performed without reference to any three dimensional real 
world space locations or dimensions (see Kreitman, col. 7, line 64 to col. 8, line 6, 
wherein the transforming step performed by transformer 64 comprises all applied 
geometric transformations of the visual content, is performed without reference to any 
content of the image sequence, and is performed without reference to any three 
dimensional real world space locations or dimensions). 

With regard to claim 2, Kreitman describes wherein the three dimensional real 
world space locations include a location of a camera which originally produced the 
image sequence (see Kreitman, col. 7, line 64 to col. 8, line 6, wherein the transforming 
step performed by transformer 64 is performed without reference to any three 
dimensional real world space locations or dimensions at all, including a location of a 
camera which originally produced the image sequence). 

With regard to claim 3, Kreitman describes wherein the three-dimensional real 
world scale dimensions comprise units of physical measurement relating to the scene of 
the image sequence (see Kreitman, col. 7, line 64 to col. 8, line 6, wherein the 
transforming step performed by transformer 64 is performed without reference to any 
three dimensional real world space locations or dimensions at all, including units of 
physical measurement relating to the scene of the image sequence). 

With regard to claim 4, Kreitman describes wherein the blending step is 
performed without reference to any three-dimensional real world space locations (see 
Kreitman, col. 6, lines 25-37 and col. 8, lines 1-9, wherein blending mask 58 is utilized 
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to blend the image 42 with the colors of the field on which the image 42 is implanted, 
without reference to any three-dimensional real world space locations). 

With regard to claim 5, Kreitman describes wherein the target location may 
change relative to the scene (see Kreitman, Fig. 3, possible target locations 52, col. 6, 
lines 17-24, wherein the implantation designer designs the image 42 to be implanted 
and determines where on the model 50 to place it at one of the plurality of target 
positions 52) and as the image sequence progresses (see Kreitman, col. 1 , lines 19-28, 
wherein target locations are re-selected as the image sequence progresses). 

With regard to claim 6, Kreitman describes wherein the image sequence is 
received from an analog video recorder, a digital video recorder or a broadcast quality 
video camera (see Kreitman, Fig. 2, broadcast quality video cameras 30 and col. 5, 
lines 22-36, wherein the image sequence is inherently received from an analog video 
recorder since videotape is can be a source of the image sequence). 

With regard to claim 18, Kreitman describes applying a transform function to a 
marker line that is to be inserted into an image sequence that was produced by a 
camera (see Kreitman, Figs. 2, 4, and col. 7, line 64 to col. 8, line 9, wherein image 42 
of Fig. 4 which is comprised of marker lines is transformed to match the perspective of 
the input video frame of Fig. 2 and is inserted into the video frame of Fig. 2); and 
blending the transformed line with the image sequence (see Kreitman, col. 6, lines 26- 
37, Fig. 4C, and col. 8, lines 1-9, wherein transformed blending mask 58 is utilized to 
blend the image 42 with the colors of the field on which the image 42 is implanted); 
wherein the transforming step and the blending step together result in insertion of the 
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line into the image sequence such that the line appears at a target location as if it had 
been part of the original scene displayed by the image sequence (see Kreitman, col. 8, 
lines 1-9, wherein if players walk on the part of the court 32 where the image 42 is 
implanted, they will appear to walk "over" the implanted image); and wherein the 
transforming step comprises all applied geometric transformations of the line, is 
performed without reference to any real-time content of the image sequence, and is 
performed without reference to any location of the camera (see Kreitman, col. 7, line 64 
to col. 8, line 6, wherein the transforming step performed by transformer 64 comprises 
all applied geometric transformations of the visual content, is performed without 
reference to any content of the image sequence, and is performed without reference to 
any three dimensional real world space locations or dimensions). 

With regard to claim 22, Kreitman describes applying a transform function to a 
virtual sign that is to be placed into an image sequence that was produced by a camera 
(see Kreitman, Figs. 2, 4, and col. 7, line 64 to col. 8, line 9, wherein image 42 of Fig. 4 
is transformed to match the perspective of the input video frame of Fig. 2 and is inserted 
into the video frame of Fig. 2); and blending the transformed sign with the image 
sequence (see Kreitman, col. 6, lines 26-37, Fig. 4C, and col. 8, lines 1-9, wherein 
transformed blending mask 58 is utilized to blend the image 42 with the colors of the 
field on which the image 42 is implanted); wherein the transforming step and the 
blending step together result in insertion of the sign into the image sequence such that 
the sign appears at a target location as if it had been part of the original scene displayed 
by the image sequence (see Kreitman, col. 8, lines 1-9, wherein if players walk on the 



Application/Control Number: 10/613,273 Page 9 

Art Unit: 2672 

part of the court 32 where the image 42 is implanted, they will appear to walk "over" the 
implanted image); and wherein the transforming step comprises all applied geometric 
transformations of the sign, is performed without reference to any content of the image 
sequence, and is performed without reference to location of the camera (see Kreitman, 
col. 7, line 64 to col. 8, line 6, wherein the transforming step performed by transformer 
64 comprises all applied geometric transformations of the visual content, is performed 
without reference to any content of the image sequence, and is performed without 
reference to any three dimensional real world space locations or dimensions). 

With regard to claim 26, Kreitman describes applying a transform function to 
visual content to be inserted into an image sequence, wherein the image sequence 
includes a moving object (see Kreitman, Figs. 2, 4, and col. 7, line 64 to col. 8, line 9, 
wherein image 42 of Fig. 4 is transformed to match the perspective of the input video 
frame of Fig. 2 and is inserted into the video frame of Fig. 2, and wherein the input video 
frame includes moving objects such as tennis players 44 of Fig. 6); and blending the 
transformed visual content with the image sequence (see Kreitman, col. 6, lines 26-37, 
Fig. 4C, and col. 8, lines 1-9, wherein transformed blending mask 58 is utilized to blend 
the image 42 with the colors of the field on which the image 42 is implanted); wherein 
the transforming step and the blending step together result in insertion of the content 
into the image sequence such that the content appears at a target location as if it had 
been part of the original scene displayed by the image sequence, and such that the 
content is located on the moving object as the object moves in the scene (see Kreitman, 
col. 8, lines 1-9, wherein if the tennis players walk on the part of the court 32 where the 
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image 42 is implanted, they will appear to walk "over" the implanted image); and 
wherein the transforming step comprises all applied geometric transformations of the 
visual content, is performed without reference to any content of the image sequence, 
and is performed without reference to any three dimensional real world space locations 
or dimensions (see Kreitman, col. 7, line 64 to col. 8, line 6, wherein the transforming 
step performed by transformer 64 comprises all applied geometric transformations of 
the visual content, is performed without reference to any content of the image 
sequence, and is performed without reference to any three dimensional real world 
space locations or dimensions). 

With regard to claim 34, Kreitman describes applying a transform function to 
transform a first point P[A] within a first image to a second point P[B] within a second 
image (see Kreitman, Figs. 2, 4, and col. 7, line 64 to col. 8, line 9, wherein image 42 of 
Fig. 4 is transformed to match the perspective of the input video frame of Fig. 2 and is 
inserted into the video frame of Fig. 2); wherein the first image contains content related 
to a first camera view (see Kreitman, Fig. 3 and col. 6, lines 7-16, wherein image 42 is 
content related to the computer's inherent virtual camera "top view" of geometric tennis 
court model 50); wherein the second image contains content related to a second 
camera view (see col. 7, lines 30-67, wherein the input video frame is generated by 
active camera 30); wherein the point P[A] corresponds to the same location within real 
world space as point P[B] (see Kreitman, col. 6, lines 7-16, wherein the geometric tennis 
court model 50 is a scaled version of the real tennis court 32, therefore, points on the 
two tennis courts correspond); wherein the transforming step is performed without 
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reference to any content of the first image and the second image; wherein the 
transforming step is further performed without reference to any three-dimensional real 
world space locations or dimensions as related to the content of the first image and the 
second image (see Kreitman, col. 7, line 64 to col. 8, line 6, wherein the transforming 
step performed by transformer 64 comprises all applied geometric transformations of 
the visual content, is performed without reference to any content of the image 
sequence, and is performed without reference to any three dimensional real world 
space locations or dimensions). 

With regard to claim 35, Kreitman describes a set of fixed transform parameters 
(see Kreitman, col. 7, lines 58-63, generally the features of the playing field, specifically, 
tennis court lines 38 which are fixed and which are used to produce a transform matrix); 
first sensor data received from a first camera corresponding to the first camera view 
(col. 7, line 64 to col. 8, line 9, image 42, wherein image 42 is sensed data related to the 
computer's virtual camera "top view" of geometric tennis court model 50 of Fig. 3); 
second sensor data received from a second camera corresponding to the second 
camera view (col. 7, line 64 to col. 8, line 9, the input video frame captured by cameras 
30 as shown in Fig. 2); a set of dynamic transform parameters that are based on the 
fixed transform parameters, the first sensor data and the second sensor data (see 
Kreitman, col. 8, lines 1-9, wherein transformed blending mask 58 is a dynamic 
parameter because it is utilized to blend the image 42 with the dynamic colors of the 
video image on which the image 42 is implanted). 
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With regard to claim 36, Kreitman describes pan information; tilt information; 
zoom information; and focus information (see Kreitman col. 3, lines 33-39, wherein pan 
information is the same as turn information turn information, and wherein focus 
information is inherent for a camera). 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 30 is rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kreitman, U.S. Patent No. 5,491,517, in view of Rosser, U.S. Patent No. 6,750,919. 

With regard to claim 30, Kreitman describes applying a transform function to 
visual content (see Kreitman, Figs. 2, 4, and col. 7, line 64 to col. 8, line 9, wherein 
image 42 of Fig. 4 is transformed to match the perspective of the input video frame of 
Fig. 2 and is inserted into the video frame of Fig. 2); and blending the transformed visual 
content with an image sequence (see Kreitman, col. 6, lines 26-37, Fig. 4C, and col. 8, 
lines 1-9, wherein transformed blending mask 58 is utilized to blend the image 42 with 
the colors of the field on which the image 42 is implanted); wherein the transforming 
step and the blending step together result in insertion of the content into the image 
sequence such that the visual content appears as if it had been part of the original 
scene displayed by the image sequence (see Kreitman, col. 8, lines 1-9, wherein if 
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players walk on the part of the court 32 where the image 42 is implanted, they will 
appear to walk "over" the implanted image); wherein said transforming step comprises 
all applied geometric transformations of the visual content, is performed without 
reference to any real-time image content of the image sequence and is performed 
without reference to any three dimensional real world space locations as related to the 
image sequence (see Kreitman, col. 7, line 64 to col. 8, line 6, wherein the transforming 
step performed by transformer 64 comprises all applied geometric transformations of 
the visual content, is performed without reference to any content of the image 
sequence, and is performed without reference to any three dimensional real world 
space locations or dimensions). Kreitman fails to explicitly describe dynamically 
changing visual content, as required by claim 30. However, DiCicco teaches 
dynamically changing visual content (see Title and Abstract of DiCicco). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention by applicant to modify Kreitman to incorporate the dynamically changing visual 
content of Rosser, because Kreitman uses advertising as its visual content, and 
dynamically changing visual content is more likely to be attractive to the viewer, and is 
more likely to get the viewer's attention. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eric V. Woods whose telephone number is 571-272- 
7775. The examiner can normally be reached on M-F 7:30-4:30 alternate Fridays off. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi can be reached on 571-272-7664. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Eric Woods August 30, 2005 
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